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Abstract 

Markov chain models had proved to be useful tools in many fields, such as physics, chemistry, 
information sciences, economics, finances, mathematical biology, social sciences, and statistics 
for analyzing data. A discrete time Markov chain is often used as a statistical model from 
a random physical process to fit the observed data. A time-homogeneous Markov chain is a 
process that each transition probability from a state to a state does not depend on time. It 
is important to test if the assumption of the time-homogeneity of the chain fits the observed 
data. In 2011, Hara and Takemura suggested a Markov Chain Monte Carlo (MCMC) approach 
to a goodness-of-fit test using Markov bases on the toric homogeneous Markov chain (THMC) 
model and gave a full description of the Markov bases for the two-state THMC model which does 
not depend on time T. In this paper, we provide a bound on the degree of the Markov bases 
for the three-state THMC model (without loops and initial parameters), when the transition 
probabilities of the Markov chains are assumed to be independent of the time. Our proof is 
based on a result due to Sturmfels, who gave a bound on the degree for the generators of toric 
ideals, provided the normality of the corresponding toric variety. In our setting, we proved the 
normality of the semigroup generated by the columns of the design matrix associated to the 
THMC model by studying the geometric properties of the polytope associated to the design 
matrix of the model. Moreover, we give a complete description of the facets of this polytope, 
which does not depend on the time. 

Keywords: Markov bases, toric homogeneous Markov chains, polyhedrons, semigroups 



1. Introduction 

A discrete time Markov chain, Xt for t = 1,2,..., is a stochastic process with the Markov 
property, that is P(X t +i = y\X 1 = x\, . . . ,X t -i = x t -i,X t = x) = P(X t+1 = y\X t = x) for 
any states x, y. Discrete time Markov chains have applications in several fields, such as physics, 
chemistry, information sciences, economics, finances, mathematical biology, social sciences, and 
statistics |S]. In this paper, we consider a discrete time Markov chain Xt, with t = 1, . . . ,T 
(T > 3), over a finite set of states [S] = {1, . . . , S}. In this paper we focus on 5* = 3. 

Discrete time Markov chains are often used in statistical models to fit the observed data 
from a random physical process. Sometimes, in order to simplify the model, it is convenient to 
consider time- homogeneous Markov chains, where the transition probabilities do not depend on 
the time, in other words, when 

P{X t +\ = y\X t = x) = P(X% = y\X% = x) for all states x, y and for any t = 1 . . . , T. 
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In order for a statistical model to reflect the observed data, it is necessary to verify if the 
model fits the date via the goodness-of-fit test. For instance, for the time-homogeneous Markov 
chain model, it is necessary to test if the assumption of time-homogeneity fits the observed data. 
In this paper, we study some properties of these algebraic relations for the toric homogeneous 
Markov chain (THMC) model, which is a slight generalization of the time-homogeneous Markov 
chain model, and which we explain as follows. 

Let w = si • • • st denote a word of length T on states [S]. Let p(w) denote the likelihood 
of observing the word w. Since the time-homogeneous Markov chain model assumes that the 
transition probabilities do not depend on time, we can write the likelihood as the product of 
probabilities 

p(w) = 7T Sl p Sl ,s 2 ■ ■ -Pst-USTI ( L1 ) 

where, n Si indicates the initial distribution at the first state, and p SitSj are the transition prob- 
abilities from state Si to sj. In usual time- homogeneous Markov chain model it is assumed 
that the row sums of the transition probabilities are one: Ylj=iPi,j = 1 ; Vi G [S]. On the 
other hand, in the toric homogeneous Markov model (1.1), the parameters pij are free and we 
do not assume that the row sums of the transition probabilities are one. This simplifies the 
model as we can disregard some information from it. Also in many cases the parameters ir si 
for the initial distribution are known, or sometimes these parameters are all constant, namely 
it i = 7T2 = • • • = tts = c; in this situation it is no longer necessary to take them in consideration 
for the model. Another simplification that arises from practice is when the only transition prob- 
abilities considered are those between two different states, i.e. when pi = whenever i = j; 
this situation is referred as the THMC model without self-loops. 

In [H], Takemura and Hara suggested a Markov Chain Monte Carlo (MCMC) approach for 
the goodness-of-fit test using Markov bases of the THMC model. A Markov basis is a set of moves 
between data sets with the same sufficient statistics so that the transition graph for the MCMC 



is guaranteed to be connected for any observed value of the sufficient statistics (see Section 2.1 



and |8j). A Markov basis can be encoded by polynomial relations among the probabilities pij. 
The set of all these algebraic relations is the toric ideal associated to the model. 

In |llj . the authors provided a full description of the Markov bases for the THMC model 
in two states (i.e. when 5 = 2) that does not depend on T. Inspired by their work, we study 
the algebraic and polyhedral properties of the Markov bases of the three-state THMC model 
without initial parameters and without self- loops for any time T > 3. As a result, we proved 
that the Markov bases of the model consist of binomials of degree at most 6. Our proof relies on 
the normality of the semigroup generated by the columns of the design matrix for the three-state 
THMC model for any time T > 3, which we settle using a complete description of the facets of 
the convex hull generated by the columns of the design matrix. 

The outline of this paper is as follows. In Section [2j we recall some definitions from Markov 
bases theory. In Section [3j we explicitly describe the hyperplane representation of the convex 
hull generated by the columns of the design matrix for the three-state THMC model for any time 
T > 4. Then, in Section [4] we show the normality of the semigroup generated by the columns 
of the design matrix for the three-state THMC model for any time T > 3. Finally, using these 
results, we present the proof of our bound on the degree of the Markov basis in Section [5j 
and we finalize that section with some observations based on the analysis of our computational 
experiments. 
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2. Notation 

Let (S) T be the set of all words of length T on states [S] such that every word has no self- 
loops; that is, if w = (si, . . . ,st) G (S) T then Si / Si+i for i = 1, . . . ,T — 1. We define V*((S) T ) 
to be the set of all multisets of words in (S) T . 

Let V ((S) T ) be the real vector space with basis (S) T and note that V ((S) T ) R S ^ S -^ T . 
We recall some definitions from the book of Pachter and Sturmfels [7j- Let A = (ay) be a 
non-negative integer d x m matrix with the property that all column sums are equal: 

d d 

Oil = ^2 
i=l i=l 

Write ^4 = [a± d2 • • • a m ] where a,- are the column vectors of A and define 6 aj = Y\i=i f° r 
j = 1, ... ,m. The tone model of j4 is the image of the orthant M> under the map 

f-.R d ^R m , 1 (e a \...,e a ™). 

Here we have (i parameters = (9i, . . . , 0^) an d a discrete state space of size m. In our setting, 
the discrete space will be the set of all possible words on [5] of length T without self- loops {(S) T ) 
and we can think of 9i, . . . , 9d as the probabilities pi,2,Pi,3, • • • ,PS-i,S- 

In this paper, we focus on the THMC model without initial parameters and with no self- loops 
in three states, (i.e., S = 3), which is parametrized by 6 positive real variables: pi2, P13, P21, P23, 
P3l, P3,2- Thus, the number of parameters is d = 6 and the size of the discrete space is m = 6 T_1 , 
which is precisely the number of words in (3) T . The model we study is thus the toric model 
represented by the 6 x 6 T_1 matrix A T , which will be referred to as the design matrix for the 
model on 3 states with time T. The rows of A T are indexed by elements in (3) 2 and the columns 
are indexed by words in (3} T . The entry of A T indexed by row o\Oi G (3) 2 , and column w = 
(si, . . . , st) G (3) t is equal to the cardinality of the set { i G {1, . . . , T — 1} | 0~\O2 = SiSj+i }. 



Example 2.1. Ordering (3) 2 and (3) T lexicographically, and letting T = 4, the matrix A A is: 
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2.1. Sufficient statistics, ideals, and Markov basis 

Let A T be the design matrix for the THMC model without initial parameters and with no 
self-loops. The column of A T indexed by w G (3) T is denoted by a^. Thus, by extending 
linearly, the map A T : Y((3) T ) — > M 6 is well-defined. 

Let W = {wi,...,w N } G V*((3) T ) where we regard W as observed data which can be 
summarized in the data vector u G N 6 . We index u by words in (3} T , so the coordinate 
representing for the word w in the vector u is denoted by n w , and its value is the number of 
words in W equal to w. Note since A T is linear then A T u is well-defined. We also adopt the 
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notation A T (W) := A T u. For W from V*((3) T ), let u be its data vector, the sufficient statistics 
for the model are stored in the vector A T u. Often the data vector u is also referred to as a 
contingency table, in which case A T u is referred to as the marginals. 

The design matrix A T above defines a toric ideal which is of central interest in this paper, 
as their set of generators are in bijection with the Markov bases. The toric ideal I^r is defined 
as the kernel of the homomorphism of polynomial rings tp : <C[{p(w) | w G (S) T }] — > C[{pij \ 
i,j G [3], i ^ j }] defined by V(p( w )) — Psi,s2 ' ' "Ps T -i,st' where {p(w) | w G (S) T } is regarded 
as a set of indeterminates. 

The set of all contingency tables (data vectors) satisfying a given set of marginals b G Z> is 
called a fiber which we denote by J-y, = { x G Z> | ^4 T (x) = b }. A move z G Z m is an integer 
vector satisfying A T (z) = 0. A Markov basis for our model defined by the design matrix A T is 
defined as a finite set Z of moves satisfying that for all b and all pairs x, y G J 7 ^ there exists a 
sequence zi, . . . , zk G Z such that 

K i 
y = x + Zfc, with x + z^ > 0, for all / = 1, . . . , K. 

k=\ k=\ 

A minimal Markov basis is a Markov basis which is minimal in terms of inclusion. See Diaconis 
and Sturmfels[2j for more details on Markov bases and their toric ideals. 

2.2. State Graph 

We give here a useful tool to visualize multisets of V*((3) T ). Given any multiset W G 
V*((3) T ) we consider the directed multigraph called the state graph G(W). The vertices of 
G(W) are given by the states [3] and the directed edges i — > j are given by the transitions from 
state i to j in w G W. Thus, we regard w G W as a path with T — 1 edges (steps, transitions) 
in G(W). 

See Figure[l]for an example of the state graph G(W) of the multiset W = {(12132), (12321)} 
of paths with length 4. Notice that the state graph in Figure [T]is the same for another multiset 
of paths W = {(13212), (21232)}. 
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Figure 1: The state graph G{W) of W = {(12132), (12321)}. Also the state graph G(W) where W = 
{(13212), (21232)}. 

From the definition of state graph it is clear that it records the transitions in a given multiset 
of words and we state the following proposition. 

Proposition 2.2 (Proposition 2.1 in [5j). Let A be the design matrix for the THMC, and 
W,W G V*((S) T ). Then A(W) = A(W) if and only if G{W) = G(W). 
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Throughout this paper we alternate between terminology of the multisets of words W and 
the graph it defines G(W). 

2.3. Semigroup and Smith Normal Form 

Given an integer matrix A G ^ dxm we associate an integer lattice "LA = {niai + • • • +n m a m | 
rii G Z}. We can also associate the semigroup N^4 := {raiai + • • • + n m a. m | G N}. We say 
that the semigroup NA is normal when x G NA if and only if there exist y G Z d and a G R> 
such that x = Ay and x = Aa. The set of vectors Aa is called the saturation of NA. See [6j [TO] 
for more details on normality. 

For an integer matrix A G Z rfxm , we consider the Smith normal form D of A, which is a 
diagonal matrix D for which there exist unimodular matrices U G Z a!xd and V G ^ mxm ; such 
that UAV = D. The Smith normal form encodes the Z-module structure of the abelian group 
7LA := {n\Ai + • • • + n m A m \ rii G Z}. Some additional material about the Smith normal form 
for matrices with entries over a PID can be found in the book of C. Yap [12]. The Smith normal 
form is important for studying the normality of the toric ideal associated to the model. 

Proposition 2.3 (Proposition 3.2 in [5]). Let A S,T be the design matrix for the THMC without 
initial parameters and no self-loops on S > 1 states with time T > 0. For S > 3 and T > 4, the 
Smith normal form of the design matrix A S,T is D = diag(l, . . . , 1, T — 1). 



3. Facets of the design polytope 

3.1. Poly topes 

We recall some necessary definitions from polyhedral geometry and we refer the reader to 
the book of Schrijver [9] for more details. The convex hull of {ai, . . . , a m } C M. n is defined as 

{mm ^ 
x £ M" | x = ^ Ajaj, y^Aj = 1, Xj > > . 
i=i i=i J 

A polytope P is the convex hull of finitely many points. We say F C P is a face of the 
polytope P if there exists a vector c such that F = arg max x6 p c • x. Every face F of P is also 
a polytope. If the dimension of P is d, a face F is a /acei if it is of dimension d — 1. For A; G N, 
we define the fc-th dilation of P as := { fcx | x G P, }. A point x G P is a vertex if and only 
if it can not be written as a convex combination of points from P\{x}. 

The cone of {ai, . . . , a m } C M n is defined as 

cone(ai, . . . ,a m ) := j x G R n \ x = ^ A^, A» > | . 

Thus, cone(A) denote the cone over the columns of the matrix A. We are interested in the 
polytope given by the convex hull of the columns of the design matrices of our model. We define 
the design polytope P T as the convex hull conv(^4 r ) of the columns of the design matrix A T . 
Notice that in this case, P T has dimension 6. 

If x G M 6 , we index x by { ij \ 1 < < 3, i ^ j }■ We define e^- G M 6 to be the vector of 
all zeros, except 1 at index ij. We also adopt the notation xi + := J2j x ij an d %+i '■= J2j x ji- 
For any x G N 6 we can define a directed multigraph G(x) on three vertices, where there are Xij 
directed edges from vertex i to vertex j. One would like to identify the vectors x G N 6 for which 



6 



the graph G(x) is a state graph. Nevertheless, observe that Xj+ is the out-degree of vertex i and 
x+i is the in-degree of vertex i with respect to G(x). 

We now give some properties which will be used later for describing the facets of the design 
polytope P T given by the design matrix for our model, and to prove normality of the semigroup 
associated with the design matrix. 

Proposition 3.1 (Proposition 5.1 in [5|). Let A T be the design matrix for the THMC without 
loops and initial parameters. 7/x 6 IjA t n cone(^4 T ) then x ij = k{T ~~ 1) f or som & k G N 
and — x+i\ < k for all i G {1, 2, 3}. 



Proposition 3.1 states that for x £ 7jA t n cone(A T ) the multigraph G(x) will have in-degree 
and out-degree bounded by ||x||i/(T — 1) at every vertex. This implies nice properties when 
||x||i = (T — 1). Recall that a path in a directed multigraph is Eulerian if it visits every edge 
only once. 

Proposition 3.2 (Proposition 5.2 in |5j). If G is a directed multigraph on three vertices, with 
no self-loops, T — 1 edges, and satisfying 

\G i+ -G +i \<l i = 1,2,3; 

then, there exists an Eulerian path in G. 

Note that every word w G V*((3) T ) gives an Eulerian path in G({w}) containing all edges. 
Conversely, for every multigraph G with an Eulerian path containing all edges, there exists 
w G V*({3) T ) such that G({w})= G. More specifically, w is the Eulerian path in G({w}). 
Throughout this paper we use the terms path and word interchangeably. 

Lemma 3.3 (Lemma 5.2 in [5J). Let A T be the design matrix for the THMC. If T > A, then 
conv(A T ) nZ 6 = A T , where the right hand side is taken as the set of columns of the matrix A T . 



We define 



Hk(T-l) 



x G M 6 | ^2 = k(T- 1) 



Proposition 3.4 (Proposition 5.3 in [5]). Let A T be the design matrix for the THMC without 
initial parameters and no loops. 

1. For T > 4 and k G N, 

kconv(A T ) = cone(^4 T ) n Hk(T-l)- 

2. For T > A, 

oo 

cone(^ T ) n ZA T = (kconv{A T ) n Z 6 ) . 

k=0 

3.2. Facets 

In this section we give the facets of the design polytope P T for S = 3 and arbitrary T. Recall 
that vectors c G M 6 are indexed as [012,013,021,023,031,032]. The proofs for the facets of P T 
rely heavily on the state graph. Note that we give the facets of the design polytope in terms 
of equivalence classes under permutations of the labels {1,2,3}. For example, if £3 denote the 
set of permutations of the set {1,2,3}, and the vector (012,013,021,023,031,032) defines a facet, 
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for any a G 63, the vector (c^y^) , c a ^ a ^, c a ( 2 )a(l), c a (2)a(3), c <r(3)a(l), c o-(3>(2)) also defines a 
facet. 

Notice that by definition, the transition count between states should be a non-negative 
integer, thus we have the following facet. 

Proposition 3.5. For any T > 5, the row vector 

c = [1,0,0,0,0,0] 

defines a facet of P T modulo 63. 

Recall that in general, to show that a vector c forms a facet of P T ', we need to show the 
following two things: 

i) The elements of ca^ are non-negative for all w 6 (3) T . 

ii) The dimension of linear subspace spanned by {a^ | ca^ = 0} is 5; 

where c a denotes the vector multiplication of the row vector c times the column vector a. 
Proposition 3.6. For any T > 5, the row vector 

c=[T,T,-(T-2),l,-(T-2),l] 
defines a facet of P T modulo 63. 

Proof. We now check i). Consider any particular word (path) w E (3) T of length T with 
transition counts 212, £13, 221, 223, 231, £32- We need to show 

T(x 12 + xi 3 ) + x 2 3 + x 32 >(T- 2)(x 2 i + x 31 ). (3.1) 

Note that 2x2 + 213 is the out-degree of vertex 1 and x 2 i + 231 is the in-degree of vertex 1 with 
respect to the graph G(w). By Proposition 3.1 the out-degree and the in-degree can differ by 



at most 1. Note that (J3JJ) trivially holds when 212 + ^13 > x 2 \ + X31. Hence we only need to 
check the case a = x\ 2 + 213 = x 2 \ + x 2 \ — 1. Now 

T - 1 = x X2 + X13 + x 2 i + x 2 3 + £31 + x 32 = 2a + 1 + x 2 3 + £32 

or 

2a + 2 + x 23 + X32 ~ T = 0. 



Hence the difference of two sides of (3.1) is written as 

Ta + x 23 + 232 - (T - 2)(o + 1) = 223 + ^32 + 2(a + 1) - T = 0. (3.2) 

This proves i). 

Next we consider ii). Equation (3.1) can not hold with equality in the case 212 + 213 > 
X21 + X31. Also (3.1) can not hold with equality in the case 212 + 213 = 221 + 231 > 0. 
Furthermore if = 212 + 213 = 221 +231, then the path entirely consists of edges between 2 and 
3. Then T — 1 = 232 + 223 > and (3.1 ) does not hold with equality. Hence the only remaining 
case is 212 + 213 = 221 + 231 — 1. But then from (3.2) we see that (3.1) holds with equality. 
Hence all paths w such that 212 + 213 = 221 + 231 — 1 satisfies ca^ = 0. We now give five such 
paths with linearly independent sufficient statistics, which depends on T mod 3 and T mod 2. 
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If T even, consider 

3131 • • • 131, 2121 • • • 121, 3232 • • • 3231 

If T odd, consider 

23131 • • • 31, 32121 • • • 21, 2323 • • • 231 
If T = (mod 3), consider 

321321 •••321, 231231 •• -231 

If T = 2 (mod 3), consider 

213213- •• 2131, 312312- • -3121 

Finally if T = 1 (mod 3), put the loop 232 or 323 in front of the word above for the value 
of T = 2 (mod 3). 

We need to show that the sufficient statistics of these paths are linearly independent. For 
example, consider the case T = 6k. Then the sufficient statistics are given by the vectors 

[0,3k - 1,0,0, 3fc,0], [3fc- 1,0, 3k, 0,0,0], [0, 0, 0, 3Jfe — 1, 1, 3Ar — 1], 

[0, 2k - 1, 2k, 0, 0, 2k], [0, 2k, 0, 2k - 1, 2k, 0]. 

For k > 2, the linear independence of these five vectors can be easily verified. Other cases T = r 
(mod 6) can be similarly handled. n □ 

In a similar fashion, we prove the following propositions. 

Proposition 3.7. For any T = 2k + 1 odd, T > 5, the row vector 

c= [1,1,-1,-1,1,1] 

defines a facet of P T modulo 63. 
Proof. Consider 

X12 + X13 + X31 + X 32 > X 2 1 + X 2 3- (3.3) 

We can "merge" two vertices 1 and 3 as a virtual vertex 4 and consider 4 as a single vertex. 
Then the resulting graph has only two vertices (2 and 4). Then X12 + ^32 is the out-degree 
of this vertex 4. If X12 + x 32 > x 2i + x 23 then the inequality is trivial. Consider the case 
%12 + £32 = X21 + X23 — 1. We need to show that in this case we have X13 + X31 > 1. By 
contradiction assume that X13 + X31 = 0. Then the path of odd length is like 

2424242. 

However in this case x±2 + x 32 = xn + £23, which is a contradiction. Therefore we have proved 
that (3.3) holds for any path w. 

We now check for which path (3.3) holds with equality. The first case is = X13 + x^\. 
Then as we saw above we have x\2 + £32 = £21 + ^23- Other case is 1 = £13 + X31, i.e. either 
X13 = 1, X31 = or X31 = 1, X13 = 0. In the former case the path is like 

2121323 
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and in the latter case the path is like 32323121. We claim that for T = 2k + 1 > 5 the paths 
121 •• • 121, 232 •• • 232, 212 •• • 2123, 1323 • • • 232, 3121 • • • 212 



give sufficient statistics that are linearly independent and hold with equality for Equation (3.3). 
The sufficient statistics for the paths above are 

[k, 0,fc, 0,0,0], [0,0,0, k,0,k], [k - 1, 1, k, 0, 0, 0], [0, 1, 0, k - 1, 0, k], [k,0,k— 1,0, 1,0]. 

For k > 2, one can check the linear independence of these 5 vectors. □ 

We now consider any three consecutive transitions, or a path for T = 4. Let xij, 1 < i / 
j < 3, be transition counts of these three transitions. 

Lemma 3.8. Leti,j,k be distinct (i.e. {i,j,k} = {1,2,3}). Then 

Xij ~\~ Xjfc + Xjfc ^ 1. 

Proof. Suppose that x^ + Xjk + x^ = 0. Then in the three transitions, we can not use the 
directed edges ij, jk, ik. Then the available edges are ji, ki, kj. By drawing a state graph, it is 
obvious that by the edges ji, ki, kj only, we can not form a path of three transitions. □ 

Proposition 3.9. For any T > 4 of the form T = 3k + 1 (for k > 2), the row vector 

c= [2,-1,-1,-1,2,2] 

defines a facet of P T modulo 63. 
Proof. Consider the inequality 

2(xi2 + x 3 i + 232) > £13 + £21 + £23 (3.4) 



Since x i3 + x 2 i + X23 = T - 1 - (x\% + X31 + x 32 ) = 3k - (xn + ^31 + £32), ( |3.4[ ) is equivalent to 

X12 + £31 + x 32 > k. (3.5) 



If we consider paths in triples of transitions, (3.5) follows from Lemma 3.8 



Now we consider the case when the inequality \3.h\ becomes an equality. By the induction 
above, if we divide a path into triples of transitions (edges), then in each triple only one of 
x i2, X31, 5?32 has to be 1. That is, we proved above that for every three transitions (edges) the 
left-hand-side of equation (3.5) increases by one. For equality to hold, the LHS can only increase 
by exactly one. Knowing this, we consider the cases for which three transitions increases the 
LHS of Equation (3.5) by exactly one. In three transitions, a path can either come back to the 
same vertex or move to another vertex. In the former case (say ijki), the following three loops 
1321,3213,2132 increases 232 by 1. Another case going from i to j in three transitions are of the 
form 

ijij, ijkj, ikij, 

where i, j, k are different. Then appropriate ones are only the following ones: 

2121,1313,2323. 
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Therefore in three transitions, we go 2 — >■ 1, 1 — >■ 3 or 2 — > 3. Among these three, the only 
possible connection is 

2 -> 1 -> 3 

(or 2—7-3 alone). Then the loops are inserted at any point. Thus, we can consider the following 
paths 

2121321321 • • • 1321, 1313213 • • • 3213, 2323213 • • • 3213, 2132132 • • • 2132, 2121313 • • • 1313, 

(3.6) 

with sufficient statistics given by the vectors 

[1, k - 1, k + 1, 0,0, A; — 1], [Q,k + l,k— 1, 0, 1, k - 1], [0,k—l,k — 1, 2, 0, k], 

[0, k, k, 0, 0, k], [1, 2(Jfe - 1), 2, 0, k - 1, 0]; 

respectively. For k > 2 it is easily checked that these vectors arc linearly independent and satisfy 
Equation (3.5) with equality. □ 

Proposition 3.10. For any T > 5 of the form T = 3k + 2, k > 1, the row vector 

c = [2k + 1, -k, -k, -k, 2k + 1, 2k + 1] 

defines a facet of P T modulo ©3. 

Proof. Consider 

(2/c + 1)(X12 + £31 + £32) > fe(xi3 + X21 + X23)- (3.7) 

Since xi 3 + x 2 i + X23 = T - 1 - (x\ 2 + X31 + x 32 ) = 3k + 1 — (x i2 + £31 + £32), the inequality 
(3.7) is equivalent to 

(2fc + l)(xi2 + x 3 i + x 32 ) > k(3k + 1 - (X12 + x 3 i + x 32 )), 

which simplifies to 

X12 + £31 + X32 > k. (3.8) 

For a path of length 3/c + 2, consider omitting the last transition. Then we have a path of 
length 3k + 1. The inequality already holds for this shortened path by Proposition 3.9 Since 
the last transition only increases the transition counts, the same inequality holds for 3k + 2. 

Now we can find five paths by adding one of the transitions 2— >• 1, 1 — > 3, or 2— > 3 either at 
the end or at the beginning of the paths in Proposition 3.6. In this way, we obtain the following 
paths 

2121321321 • • • 13213, 2321321321 • • • 13213, 21313213 • • • 3213, 13213 • • • 3213, 2132132 • • • 21321, 

with the following vectors of frequencies: 

[1, k, k + 1, 0, 0, k - 1], [0, k,k+l,l,0,k — 1], [0, k + 1, k, 0, 1, k - 1], [0, k + l,k, 0, 0, k], 

[0,Jfe,fc+l,0,0,fc]; 



which are easily checked to be linearly independent and satisfy (3.8) with equality. 

□ 

The following lemma will be useful to show the facets of P T when T > 6 is even. 
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Lemma 3.11. Let T = 2k, with k > 1. Then, the inequality 2x\ 2 + X13 + X32 > k — 1 holds for 
every path. Moreover, the inequality is strict for every path ending at st = 2. 

Proof. We prove the lemma by induction on k. 

For k = 1, this is a path with a single transition; thus, i) and ii) are obvious, because 
2xi2 + £13 + X32 is non-negative and for two paths 12, 32 ending at S2 = 2, we have 2xi2 + X13 + 
x 32 = 1 or 2. 

Assume that the proposition holds for k. Now we prove that it holds for k + 1. For a path 
w let 

X = (X12,X1 3 ,X21,X23, ^31,^32) = 0l2 (w) , £13 (w) , X 2 1 (w) , X 2 3 (w) , X31 (w) , X32 (w)) 

denote the transition counts of w. Consider a path w of length T = 2k + 2 

W = Si . . . S 2 kS2k+\S2k+2- 

Denote w° = si . . . s 2 k and w 1 = s 2 kS2k+iS2k+2- Then 

2xi 2 (w) + xi 3 (w) +x 32 (w) = (2xi 2 (w°) + x 13 (w°) + x 32 (w )) + (2xi 2 (w 1 ) + x 13 (w 1 ) + x 32 (w 1 )). 
The inductive assumption is that 

2x 12 (w°) + xi 3 (w°) + x 32 (w°) > k - 1 

and 

s 2k = 2 =► 2x 12 (w°) + xi 3 (w°) + x 32 (w°) > k. 
We prove the first statement of the proposition. If 

2X 12 (W 1 ) + Xi 3 (w 1 ) + X321W 1 ) > 1, 

then the inequality holds for w. On the other hand it is easily seen that if 2xi2(w 1 ) +xi3(w 1 ) + 
X32(w x ) = then the only possible case is w 1 = 231. Then we have s 2 k = 2. Hence by the 
second part of the inductive assumption we also have the inequality. 

We now prove the second statement of the proposition. Let s 2 k+ 2 = 2. Note that s 2 fc+i is 
either 1 or 3. If s 2 k+i = 1, then 

2xi 2 (w 1 ) + xi 3 (w 1 ) + x 32 (w 1 ) = 2 

and the inequality for w is strict. On the other hand let s 2 k+i = 3, then there are two cases: 

w 1 = 232 or = 132. 

In the former case 2xi2(w 1 ) + xi3(w 1 ) + X32(w 1 ) = 1, but s 2 k = 2. Hence by the inductive 
assumption the inequality is strict. In the latter case 2xi2(w 1 ) +xi3(w 1 ) + X32(w 1 ) = 2 and the 
inequality is strict. □ 

Proposition 3.12. For any even T > 6, the row vector 

3 T T T T T 

c =[2 T - 1 '2'-2 +1 '-2 +1 '-2 +1 '2 ] 

defines a facet of P T modulo 63. 
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Proof. Write T = 2k, k > 3. Consider 

(3k - l)x 12 + k(x 13 + x 32 ) > (k - l)(x 2 i + x 23 + x 3 i). 

Substituting 

X21 + X 2 3 + X31 = T - 1 - (X12 + X i3 + x 32 ) =2k-l - (x 12 + X13 + x 32 ) 
into the above and collecting terms, we have 

(4k - 2)xi 2 + (2k - l)(xi 3 + x 32 ) >(k- l)(2k - 1) 

or equivalently 

2xi2 + X13 + X32 > k — 1, (3.9) 



which holds by Lemma 3.11 



It remains to show that the first inequality for T > 6 defines a facet. Consider the following 
5 paths. 

31... 31, 32... 3231, 2131... 31, 2313 . . . 13, 23123131 ... 31 
The sufficient statistics for these paths are 

[0,fc-l > 0,0,fc,0], [0,0,0,^-1,1,^-1], [0,fc-l,l,0, fc-1,0], [0,Jfe— l,0,l,fe— 1,0], [l,A;-3,0,2,fc-l, 
For k > 3, linear independence of these vectors can be easily checked. □ 
We now state some results that will be useful to treat the remaining case when T = 31. 



Lemma 3.13. Suppose that m, . . . , u& G W 71 are linearly independent vectors such that [1,1,..., 1]- 
slj = c > is a positive constant for j = 1, . . . , k. Then for any non-negative vector w G R m , 
ui + w, . . . , Ufc + w are linearly independent. 

Proof. For scalars ai,...,atk consider 

= (ui + w)ai H h (ufc + w)afc = ui«i H h u fc a fc + w(«i H h a^) (3.10) 

Taking the inner product with [1, 1, . . . , 1] we have 

= (c+[l,l,...,l]-w)(ai + ... + a fc ). 



Here c + [1, 1, . . . , 1] • w > 0. Hence we have = a\ + • • • + o^. But then (3.10 ) reduces to 

= mai H h Ufca/c 

By linear independence of Ui, . . . , u& we have ctj = 0, j = 1, . . . , k. □ 

Lemma 3.14. Let Xij, 1 < i ^= j < 3, be transition counts of three consecutive transitions and 
leti,j,k be distinct. Then 

2x{j ~1- x^. -|- Xfcj ^ Xji. (3.11) 

The equality holds for the following paths: jiji, jkji, jiki. These three paths start from j and 
ends at i. Furthermore if the difference of both sides is 1 then the possible transitions in three 
steps are j — >■ k, k —> i, and self-loops i —> i, j ^ j , k ^ k. Finally if the difference of both 
sides is 2, then the possible transitions in three steps are k — >■ j, and i — )• k, and self-loops i — >■ i, 
j -> j, k -> k. 
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Proof. If xji < 1, then the inequality is obvious from Lemma 3.8 If Xji = 2, then the only 



possible path is jiji, for which the equality holds in (3.11). 

We now consider the values of the difference of both sides. First we determine paths, where 
the equality holds, jiji is the unique solution for £jk = 2. Consider the case Xj% = 1. Then the 
equality holds only if x%j = and one of Xik and Xkj is 1. It is easy to check that the former 
case corresponds only to jiki and the latter case corresponds only to jkji. 

We now enumerate the cases that the difference is 1. If Xji = 0, then = and one of Xik 
or Xkj is zero. This is only possible for the paths jkik or kjki. (Recall that Xji = 2 leads to 
jiji, for which the difference is zero, as treated above.) Now consider Xji = 1. The case X{j = 1 
corresponds to jijk or kiji. The = corresponds the loop jikj, ikji, or kjik. We now 

see that the transitions in three steps are j — > k, k — >■ i, or the self-loops i — > i, j — > j, k — > k. 

Finally we enumerate the cases that the difference is 2. It is easy to see that Xji < 1. 
First suppose Xj% = 0. If x%j = l,Xik = %kj = 0, then this corresponds to loops (in reverse 
direction than in the previous case) ijki, jkij, kijk, resulting in self-loops in three steps. If 
Xij = 0,Xik = x^ = 1, then this corresponds to kikj or ikjk. If Xij = 0,Xik = 2,Xkj = 0, 
then this corresponds to ikik. Similarly x^ = 0,Xik = 0,Xkj = 2 corresponds to kjkj. Second 
suppose Xji = 1. LHS has to be 3. Then x^ = 1 and one of and x^j is 1. It is easy to 
see that these correspond to paths kjij and ijik. Then we see that in three steps, the possible 
transitions are k — >■ j, i — >■ k or the three self- loops. □ 



Using Lemma 3.14 we now consider 6 consecutive transitions (in two triples). Let x^, 
1 < i ^ j < 3, denote transition counts of 6 consecutive transitions. Then we have the following 
lemma. 

Lemma 3.15. Leti,j,k be distinct. Then 

2xij + x ik + x k j > Xji + 1. (3.12) 

When the equality holds, then the path has to start from j and end at i in 6 steps. When the 
difference of both sides is 1, then the possible transitions in 6 steps are j —> i, j — >• k and k — )■ i. 

Proof. From the previous lemma, 

2Xij -\- Xik Xkj ^ Xji 

but the equality is impossible, because then the path has to go from j to i in three steps twice. 



Hence ( |3.12[ ) holds. 

Now consider the case of equality. Then differences of two triples are and 1. By the 
previous lemma the order of before 1 only corresponds to j — > i — > i. The order of 1 before 
corresponds to j — > j — > i. Hence in both cases, the paths have to start from j and end at i in 
6 steps. 

Now consider the case of difference of 1, i.e. 

2Xij -j- Xik Xkj — Xji -\- 2. 

The two differences of two triples are (0, 2), (1, 1) or (2, 0). In the case of (0, 2), by the previous 
lemma, the transitions in 6 steps are j — )■ i , j — )■ k. In the case of (1,1), the transitions in 6 
steps are j — > k, k — > i or j — > i. In the case of (2,0), the transitions are k — > % or j — > i. In 
summary, the possible transitions in 6 steps are j — >■ i, j — >■ k, k — > i. 

□ 
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The final lemma is as follows. 
Lemma 3.16. Consider a path of length T = 6k + 1, i.e., path with 6k steps. Then 

2xij + Xik + x k j > xji + 2k - 1. (3.13) 
If the equality holds, then the path has to be at i at time T. 

Proof. We divide a path into k subpaths of length 6. Suppose that there exists a block for which 

2xij + x ik + x kj = Xji + 1. (3.14) 

In this block the path goes from j to i. Before another block of this type, the path has to come 
back to j. But then there has to be some block of i — > k or i — > j. For these blocks 



2X{j -\- Xi k -f" Xfcj ^ Xji -\- 3. 



(3.15) 



Therefore the deficit of 1 in (3.14) is compensated by the gain of 1 in (3.15). The lemma follows 
from this observation. The condition for equality also follows from this observation. □ 



Now we will show a facet for the cases T = 6k and T = 6k + 3, k = 1,2, . . . . 
Proposition 3.17. For T = 6k + 3, the row vector 

c = [5k + 2, 2k + 1, -4k - 1, -k, -k, 2k + 1] 
defines a facet of P T modulo 63. 
Proof. Consider 

(5k + 2)xi2 + (2k + l)xi 3 + (2fc + l)x 32 > (4fc + l)x 21 + kx 23 + kx 31 . 
The RHS is written as 

(3k + 1)2:21 + k(x2i + 223 + 231) = (3k + 1)221 + k(6k + 2 - x\ 2 - 213 - 2 32 ) 



Hence (3.16) is equivalent to 

(6A; + 2)x 12 + (3k + 1)213 + (3fc + 1)232 > (3k + 1)221 + 2k(3k + 1). 
Dividing by 3 k + 1 > 0, this is equivalent to 

2X12 + 213 + 232 > 221 + 2fc. 



(3.16) 



(3.17) 



A path has T — 1 = 6k + 2 steps. Consider the first 6k steps divided into triples of steps and 



apply Lemma 3.16 to the LHS. If the inequality in (3.13) is strict, then we only need to check 
that 

2xi2 + 213 + 232 > 221 

for the remaining two steps. This is obvious, because a transition 21 has to be preceded or 
followed by some term on the left-hand side. 
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If equality holds in (3.13), at time 6k + 1, the path is at state 1 and then the penultimate 



step is either 12 or 13. In either case we easily see that 

2X12 + X13 + ^32 > %21- 

It remains to show that the first inequality for T = 6k + 3 defines a facet. Consider the 
following 5 paths. 

23132132132132 . . . 132132, 321321 . . . 321, 213232321321321 ... 21, 
213213213 . . . 213, 21321321321 . . . 3213212121. 

The sufficient statistics for these paths are 

[0, 2k, 2k, 1, 1, 2k], [0, 2k, 2k + 1, 0, 0, 2k + 1], [0, 2k - 1, 2k, 2, 0, 2k + 1] 
[0, 2k + 1, 2k + 1, 0, 0, 2k], [2, 2k -l,2k + 2, 0, 0, 2k - 1]. 

This proves the proposition. □ 

Now we consider T = 6k. 
Proposition 3.18. For T = 6k, the row vector 

c = [10/c - 1, 4k, -8k + 2, -2k + 1, -2k + 1,4k] 
defines a facet of P T modulo ©3. 
Proof. Consider 

(10k - l)xi2 + 4kxi 3 + 4kx 32 > (8k - 2)x 2 i + (2k - l)x 23 + (2k - l)x 3 i. (3.18) 
The RHS is written as 

(6k - 13)x 2 i + (2k - l)(6k - 1 - x\ 2 - X13 - x 32 ) 



Hence (3.18) is equivalent to 

(12k - 2)xi2 + (6k - l)xi 3 + (6A; - l)x 32 > (6k - l)x 21 + (2k - l)(6k - 1) 

or 

2xi2 + £13 + x 32 > x 2 i + (2k - 1). 

The rest of the proof is similar to that of Proposition |3.17| 

It remains to show that the first inequality for T = 6k defines a facet. Consider the following 
5 paths. 

232321321321 . . . 321, 213231321321 . . . 321, 321321321321 . . . 321, 

213213 . . . 213, 212321321321 . . . 321. 

The sufficient statistics for these paths are 

[0, 2k -2,2k- 1, 2, 0, 2k], [0, 2k -1,2k- 1, 1, 1, 2k - 1], [0, 2k - 1, 2k, 0, 0, 2k] 

[0, 2k, 2k, 0, 0, 2k -1], [1, 2k - 2, 2k, 1, 0, 2k -1]. 



□ 
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Here we summarize all the inequalities in their original form and in their inhomogeneous 
form. Below we only present one of six of the inequalities with the understanding that for each 
case that any permutation of the labels {1,2,3} gives another facet. The inhomogeneous form is 
derived by substituting the equality n(T — 1) = X12 + £13 + X21 + X23 + x 3i + x 32 into the original 
form. Inhomogeneous form is essential for proving the normality of semigroup associated with 
the design matrix A T . 

For any T > 5 homogeneous 

c = [1,0,0,0,0,0] - x > 

For any T > 5, homogeneous 

c = [T, T,-(T- 2), 1, — (T — 2), 1)] • x > 

inhomogeneous 

c = [1,1,-1,0,-1,0] x> -n. 
For any T odd, T > 5, homogeneous 

c = [1,1,-1,-1,1,1] - x > 0. 

For any T > 4 of the form T = 3k + 1, k > 1, homogeneous 

c = [2,-1,-1,-1,2,2] - x > 0. 

For any T > 5 of the form T = 3k + 2, k > 1, homogeneous 

c = [2k + 1, -k, -k, -k, 2k + 1, 2k + 1] • x > 

inhomogeneous 

T — 2 

£12 + £31 + x 32 > kn= — - — n. 
For any T > 6, T:even, homogeneous 

o T T T T T 

c = [^-l,-,-- + l,-- + l,-- + l,-].x>0 

inhomogeneous 

3xi2 + £13 - £21 - £23 - £31 + £32 > -n. 
For T = 6k + 3, homogeneous 

c = [5k + 2, 2ife + 1, -4fc - 1, — fc, -fe, 2A; + 1] • x > 

inhomogeneous 

T-3 

2xi2 + xis - x 2 i + X32 > 3 n. 

For T = 6k, homogeneous 

c = [10k - 1,4k, -8k + 2, -2k + 1, -2k + 1, 4fc] ■ x > 

inhomogeneous 

T-3 

2xi2 + X13 - x 2 i + x 32 > — - — n. 
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3.3. There are only 24 facets 

In the previous section, we give 24 facets of the polytope P T for every T > 3, where death of 
the 24 facets depend on T mod 6. Here, we discuss how these 24 facets are enough to describe 
the polytope P T (the convex hull of the columns of A T ), depending on T. Let C T := cone(A T ). 

Recall that the columns of A T are on the following hyperplane 

Ht = {(xu, ■ X32) I T - 1 = X12 H h x 32 }. 



Then it is clear by Proposition 3.4 that 



p T = c T n h t . 

Let Tt denote the set of facets of the pointed cone C T . Then the facets F of P T (within H T ) 
are of the form F C Ht, F C Ft- 

For every T, let Ft denote the 24 facets prescribed in the previous section, and let Ft denote 
the set of all facets of P 3,T . Therefore we have a certain subset Ft C Ft and we need to show 
that Ft = Ft- Let Ct denote the polyhedral cone defined by Ft- It follows that Ct D Ct. Note 
that Ft = Ft if and only if Ct = Ct- Also let 

Pt = Ct n Ht- 

Then P T D P T and P T = P T if and only if C T = C T - 

The above argument shows that to prove Ft = Ft it suffices to show that 

P T C P t . (3.19) 



Let Vt be the set of vertices of Pt- Then in order to show (3.19), it suffices to show that 

V T C P t . 

Hence, if we can obtain explicit expressions of the vertices of Vt and can show that each vertex 
belongs to P T , we are done. 

In the previous section, we used only the condition T — 1 = x\% + • • • + ^32 to settle the 
equivalence between the homogeneous and inhomogeneous inequalities defining the 24 the facets 
of P T . Hence the homogeneous and the inhomogeneous inequalities are equivalent on Ht- 
Therefore, for each r = 0, . . . , 5, there exists a polyhedral region defined by 24 fixed affine 
half-spaces, say Q r , such that 

Vt = Q r n Ht, T = 6k + r, k = 1, 2, . . . 

Since Q r is a polyhedral region it can be written as a Minkowski sum of a polytope P r and 
a cone C r : 

Q r = P r + C r . 

Please note that r is modulo 6, but T is not. Recall the Minkowski sum of two sets A, B C W 1 
is simply {a + b\a£A,b£B}. The six cones and polytopes defining Q r for r = 0, . . . , 5 
are given in the Appendix and were computed using Polymake [3j. For each vertex v of P r and 
each extreme ray e of C r let Z v ,e denote the half-line emanating from v in the direction e: 

l ve = { v + te I t > 0} 
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Given the explicit expressions of v and e we can solve 

[1, 1,1,1, 1,1] -(v + te)=T-l 

for t and get 

x T — 1 — [1, ... , llv 

t := i T,v,e = 1 . J . 

(1, . . . , l)e 

Then v + t(T, v, e)e G H T . Note that 

Vt C {v + i(T, v, e)e | v : vertex of P r , e : extreme ray of C r }. 

Also clearly 

+ t(T, v, e)e | v : vertex of P r , e : extreme ray of C r } G Pt = conv(Vr)- 
The above argument shows that for proving fip = Tt it suffices to show that 

{v + t(T, v, e)e | v : vertex of P r , e : extreme ray of C r } G P T . (3.20) 
For proving ( |3.20 ) the following lemma is useful. 

Lemma 3.19. Let v G P r ande€C. If v + i(T, v, e)e G P T n Z 6 /or some T, i/ien v + t(T + 
6fe, v, e)e e P T+6fc /or all k > 0. 

Proof. If x := v + £(T, v, e)e G P T fl for some T then x corresponds to a path of length T on 
three states with no loops (word in (3) T ). Suppose e is a twodoop (threedoop) e.g. 121 (1231). 
Then x + (3fc)e G P T+6k ( x + (2k)e G p T+6k ). That is, since x is an integer point (a path) 
contained in P T , we can simply add three (or two depending on the loop) copies of the loop e 
and we will be guaranteed to have a path of the correct length meaning it will be contained in 
P T + 6 . ' □ 

By this lemma we need to compute C r only for some special small T's. We computed 
all vertices and all rays for the cases T = 12,7,20,9,16,11. The software to generate the 
design matrices can be found at https://github.com/dchaws/GenWordsTrans and the design 
matrices and some other material can be found at http : //www . davidhaws . net/THMC . html By 
our computational result and Lemma 3.19 we verified the following proposition. 

Proposition 3.20. The rays of the cones C r for r = 0, . . . ,5 are ((1,0,1,0,0,0), (1,0,0,1,1,0), 
(0,1,1,0,0,1), (0,1,0,0,1,0), (0,0,0,1,0,1)). In terms of the state graph, the rays correspond to 
the five loops 121, 131, 232, 1231, and 1321. 

Note that C r , r = 0, . . . , 5 are common and we denote them as C hereafter. Also note that 
the rays of the cone C r are very simple. Proposition 3.20 implies the following theorem. 



Theorem 3.21. The 24 facets given in Propositions pVTj \!L9\ \3~T0\ \3J2\ \3A% gJg (de- 
pending on T mod 6) are all the facets of P T = conv(A r ). 
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4. Normality of the semigroup 



From the definition of normality of a semigroup defined in Section 2.3 the semigroup NA T 
defined by the design matrix is normal if it coincides with the elements in both, the integer 
lattice 1jA t and the cone cone(A T ). 

In this section, we provide an inductive prove on the normality of the semigroup NA T for 
arbitrary T. For the first 135 values of T, we computationally verified the normality. These 
cases served as an inductive base for a proof of normality for a general T. 

Lemma 4.1. The semigroup NA T is normal for 1 < T < 135. 

Proof. The normality of the design matrices A T for 1 < T < 135 was confirmed computationally 
using the software Normal iz [lj. The software to generate the design matrices and the scripts 



to run the computations are available at https://github.com/dchaws/GenWordsTrans □ 



Using Lemma 4.1, we have prove normality in the general case in what follows. 
Theorem 4.2. The semigroup fiA T is normal for any T 6 N. 

Proof. We need to show that given any transition counts x\2, ■ ■ ■ ,^32 ; such that their sum is 
divisible by T — 1 and the counts lie in cone{A T ), there exists a set of paths having these 
transition counts. Write x = [x\2, X13, X21, X23, X31, x%2\ T and lg = [1, 1, 1, 1, 1, 1]. Let 

n = 1 6 • x/(T - 1) 

denote the number of the paths. Note that n is determined from T and x. 

We listed above inhomogeneous forms of inequalities defining facets. In all cases T = 6k + r, 
r = 0,1, ... ,5, the inhomogeneous form of inequalities for n paths can be put in the form 

C12S12 H V 032^32 > a T n, (4.1) 

where C12, • • • , C32, ax do not depend on n. 

Let Q r denote the polyhedral region defined by the inequalities for T = 6k + r and just one 
path. We have computed the ^-representation 

Q r = pr + Cj 

where P r is a polytope and C is the common cone. The n-th dilation of Q r is 

Q r n ■= n Q r = nP r + nC = nP r + C. 



Then from (4.1) we have 

cone(^ T ) n {x I 1 6 • x = n(T - 1)} = Q r n n {x | 1 6 • x = n(T - 1)}. 

We now look at vertices of P r from Appendix. The vertex [0,3,4,3,0,7] for Q 2 has the largest 
Li-norm, which is 17. Hence the sum of elements of these vertices P r n are at most 17n. 

Any non-negative integer vector x with \% ■ x = n(T — 1), T = 6k + r, belonging to cone(^4 T ) 
is written as 

x = b + aiei + a2e2 + 0363 + + a^, b G nP[, «i > 0, i = 1, . . . , 5. 
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Taking the inner product with 1q (i.e. the Li-norm) we have 

1 6 • b < 17n. (4.2) 

Hence 

n(T — 1) = lg • x < Yin + 2{a\ + a 2 + 03) + 3(ct4 + 05). 
Consider the case that 

ai, 0:2, «3 < 3ra, 04,05 < 2n. (4.3) 

Then 

n(T - 1) = 1 6 • x < 17n + 18n + Yin = Yin 
or T < 48. Hence if T > 48 we have at least one of 

oi\ > 3ra, «2 > 3n, 03 > 3n, Q4 > 2n, 05 > 2ra. (4.4) 

Now we employ induction on k for T = 6k + r. Note that we arbitrarily fix n > 1 and use 
induction on /c. For k < 21 we have T = 6k + r < 126 + r < 131 < 135 and the normality holds 
by the computational results. 

Now consider k > 22 and let T = 6k + r. In this case at least one inequality of (4.4) holds. 

Let 

x G cone(^ T ) n {x \ 1 6 • x = n(T - 1)} 

First consider x such that ol\ > 3n. (The argument for a.2 and 03 is the same.) Let 

x = x — 3nei E cone(A T ) Pi {x | lg • x = n(T — 1 — 6)} 

Our inductive assumption is that there exists a set of paths wi, . . . , w n of length T — 6 having 
x as the transition counts. We now form n partial paths of length 6: 

n times ijijij 

Note that instead of ijijij we can also use jijiji- We now argue that these n partial paths can 
be appended (at the end or at the beginning) of each path wi, . . . , w n . 
Let Wi = si . . . st-6- If s i 7^ $T-6, then 

{si,ST- 6 }n{i,j}^0, 

since \S\ =3. In this case we see that at least one of the following 4 operations is possible 

1. put ijijij at the end of wi 

2. put jijiji at the end of wi 

3. put ijijij in front of wi 

4. put jijiji in front of wi 

Hence wi can be extended to a path of length T. Now consider the case that s\ = st-6> 
i.e., wi is a cycle. It may happen that s\ / i,j. But a cycle can be rotated, i.e., instead of 
Wi = si . . . st-6 we can take 

= S 2 S 3 . . . ST-6S1 

where S2 7^ s\, hence S2 = i or j. Then either ijijij or jijiji can be put in front of and 
can be extended. Therefore we see that wi can be extended in any case. Similarly W2, . . . , w„ 
can be extended. 

The case of 04 > 2n is trivial. The path ijkijk can be rotated as jkijki or kijkij. Therefore 
one of them can be appended to each of wi, . . . , w n . □ 
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5. Discussion 



In this paper, we considered only the situation of the toric homogeneous Markov chain 



(THMC) model ( 1.1 ) for S 1 = 3, with the extra assumption of having non-zero transition proba- 
bilities only when the transition is between two different states. In this setting, we described the 
hyperplane representations of the design polytope for any T > 4, and from this representation 
we showed that the semigroup generated by the columns of the design matrix A T is normal. 

We recall from Lemma 4.14 in [10], that a given set of integer vectors {ai, . . . , a n } is a graded 
set, if there exists w E Q s such that a.j • w = 1. In our setting, the set of columns of the design 
matrix A T is a graded set, as each of its columns add up to T — 1, so we let w = (^zr, . • ■ , srr). 

In his same book, Sturmfels provided a way to bound the generators of the toric ideal 
associated to an integer matrix A, the precise statement is the following. 

Theorem 5.1 (Theorem 13.14 in[TU]). Let A C Z d be a graded set such that the semigroup 
generated by the elements in A is normal. Then the toric ideal I a associate with the set A is 
generated by homogeneous binomials of degree at most d. 



In our setting, Theorem 4.2 demonstrates the normality of the semigroup generated by the 



columns of the design matrix A T , so as a consequence we obtain the following theorem: 

Theorem 5.2. For S = 3 and for any T >A, a Markov basis for the toric ideal L a t associated 
to the THMC model (without loops and initial parameters) consists of binomials of degree at 
most 6. 



The bound provided by Theorem 5.2 seems not to be sharp, in the sense that there exists 
Markov basis whose elements have degree strictly less than 6. In our computational experiments, 
we found evidence that more should be true. Our observations hold in a more general setting. 
For any S and T, let A S,T denote the design matrix for the THMC model in S states. 

Conjecture 5.3. Fix S > 3; then, for every T > 4, there is a Markov basis for the toric ideal 
Ia s > t consisting of binomials of degree at most S — 1, and there is a Grobner basis with respect 
to some term ordering consisting of binomials of degree at most S. 

We also noted that for S > 4, the semigroup generated by the columns of A S,T is not normal. 
For example, S = 4, T = 8, gax2l2i2i2 ^ 5 a 34343434 * s an integral solution in the intersection 
between the cone and the integer lattice. However this does not form a path. Thus it is 
interesting to investigate that for any S > 4 and for any T > 5 what the necessary and sufficient 
condition is for the semigroup generated by the columns of the design matrix A S,T to be normal. 



6. appendix 

CT = C := cone ([1,0, 1,0, 0,0], [1,0, 0,1, 1,0], [0,1, 1,0,0,1], [0,1, 0,0,1,0], [0,0,0,1,0,1]). 
for r = 0, . . . , 5. 

vcrt(Q°) := ([3, 0, 0, 4, 4, 0], [4, 0, 0, 3, 4, 0], [2, 0, 0, 4, 3, 2], [2, 2, 0, 2, 5, 0], [4, 0, 2, 2, 3, 0], [0, 4, 3, 0, 0, 4], [0, 2, 2, 2, 0, 5], [0, 4, 
2, 0, 2, 3], [2, 2, 4, 0, 0, 3], [3, 0, 0, 4, 2, 2], [3, 2, 0, 2, 4, 0], [5, 0, 2, 2, 2, 0], [0, 2, 2, 1, 0, 2], [1, 2, 2, 0, 0, 2], [0, 1, 1, 0, 0, 1], [1, 0, 0, 1, 

1, 0], [2, 1, 0, 2, 2, 0], [2, 0, 0, 2, 2, 1], [0, 2, 2, 0, 1, 2], [2, 0, 1, 2, 2, 0], [2, 3, 4, 0, 0, 2], [0, 5, 2, 0, 2, 2], [0, 3, 2, 2, 0, 4], [4, 0, 2, 3, 2, 0], 
[2, 2, 0, 3, 4, 0], [2, 0, 0, 5, 2, 2], [4, 0, 0, 4, 3, 0], [2, 2, 5, 0, 0, 2], [0, 4, 3, 0, 2, 2], [0, 2, 3, 2, 0, 4], [0, 4, 4, 0, 0, 3], [0, 3, 4, 0, 0, 4], [2, 0, 
2/3, 2, 7/3, 0], [4/3, 2/3, 2/3, 4/3, 7/3, 2/3], [8/5, 2/5, 4/5, 6/5, 11/5, 0], [2, 0, 0, 2, 7/3, 2/3], [6/5, 2/5, 0, 8/5, 11/5, 4/5], [3/2, 0, 0, 3/2, 

2, 0], [2/3, 4/3, 4/3, 2/3, 2/3, 7/3], [0, 8/5, 6/5, 2/5, 4/5, 11/5], [0, 2, 2, 0, 2/3, 7/3], [2/3, 2, 2, 0, 0, 7/3], [4/5, 6/5, 8/5, 2/5, 0, 11/5], [0, 
3/2, 3/2, 0, 0, 2], [7/3, 2/3, 2/3, 4/3, 4/3, 2/3], [11/5, 0, 2/5, 8/5, 6/5, 4/5], [7/3, 0, 0, 2, 2, 2/3], [7/3, 2/3, 0, 2, 2, 0], [11/5, 4/5, 2/5, 6/5, 
8/5, 0], [2, 0, 0, 3/2, 3/2, 0], [1/2, 1, 2, 1, 0, 3/2], [3/2, 0, 1, 2, 1, 1/2], [1, 1, 3/2, 1/2, 0, 2], [2, 0, 1/2, 3/2, 1, 1], [2, 1, 1/2, 1, 3/2, 0], [1, 2, 
3/2, 0, 1/2, 1], [0, 2, 1, 1, 1/2, 3/2], [1, 1, 0, 2, 3/2, 1/2], [0, 3/2, 1, 1/2, 1, 2], [1, 1/2, 0, 3/2, 2, 1], [1/2, 3/2, 2, 0, 1, 1], [3/2, 1/2, 1, 1, 2, 0], 
[0, 2, 3/2, 0, 0, 3/2], [2/3, 7/3, 2, 0, 0, 2], [4/5, 11/5, 8/5, 0, 2/5, 6/5], [0, 7/3, 2, 2/3, 0, 2], [0, 11/5, 6/5, 4/5, 2/5, 8/5], [2/3, 7/3, 4/3, 2/3, 
2/3, 4/3], [3/2, 0, 0, 2, 3/2, 0], [6/5, 4/5, 0, 11/5, 8/5, 2/5], [2, 2/3, 0, 7/3, 2, 0], [2, 0, 2/3, 7/3, 2, 0], [8/5, 0, 4/5, 11/5, 6/5, 2/5], [4/3, 2/3, 
2/3, 7/3, 4/3, 2/3], [0, 3/2, 2, 0, 0, 3/2], [2/5, 6/5, 11/5, 4/5, 0, 8/5], [0, 2, 7/3, 2/3, 0, 2], [2/5, 8/5, 11/5, 0, 4/5, 6/5], [0, 2, 7/3, 0, 2/3, 2], 
[2/3, 4/3, 7/3, 2/3, 2/3, 4/3] ). 
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vcrtlQ 1 ] := [([2, 0, 1, 2, 1, 0], [1, 0, 0, 3, 1, 1], [1, 1, 0, 2, 2, 0], [2, 1, 3, 0, 0, 0], [0, 3, 1, 0, 2, 0], [0, 1, 1, 2, 0, 2], [3, 0, 1, 1, 1, 0], [2, 0, 

0, 2, 1, 1], [2, 1, 2, 0, 0, 1], [2, 1, 0, 1, 2, 0], [0, 1, 0, 2, 0, 3], [0, 3, 0, 0, 2, 1], [0, 0, 0, 0, 0, 0], [0, 3, 1, 0, 1, 1], [0, 2, 1, 1, 0, 2], [1, 2, 2, 0, 0, 
1], [1, 2, 0, 1, 2. 0], [1, 0. 0, 3, 0, 2], [3, 0, 2, 1, 0, 0], [3, 0, 2, 0, 1, 0], [1, 0, 0, 2, 1, 2], [1, 2. 0, 0, 3, 0], [1, 1, 2, 0. 0, 2], [0, 1, 1, 1, 0, 3], [0, 2, 

1, 0. 1, 2], [2, 0, 1, 1, 2, 0], [1, 0, 0, 2, 2, 1], [1, 1, 0, 1, 3, 0], [2, 0, 3, 0, 0, 1], [0, 0, 1, 2, 0, 3], [0, 2, 1, 0, 2, 1], [1, 1, 3, 0, 0, 1], [0, 2, 2, 0, 1, 
1], [0, 1, 2, 1, 0, 2], [0, 2, 0. 1, 3, 0], [0, 0, 0, 3, 1, 2], [2, 0, 2, 1, 1, 0], [1/2, 1/2, 1/2, 1, 1/2, 0], [0, 1/2, 1/2, 1, 1/2, 1/2], [0, 1, 1/2, 1/2, 1, 0], 
[1/2, 1/2, 1, 1/2, 1/2, 0], [1, 1/2, 0, 1/2, 1/2, 1/2], [1/2, 1, 0, 0, 1, 1/2], [1/2, 1/2, 0, 1/2, 1/2, 1], [1, 1/2, 1/2, 0, 1/2, 1/2], [1/2, 1/2, 0, 1, 0, 
1], [1/2, 1, 0, 1/2, 1/2, 1/2], [1, 1/2, 1/2, 1/2, 0, 1/2], [1/2, 1, 1/2, 1/2, 1/2, 0], [1/2, 1/2, 1/2, 1, 0, 1/2], [1, 1/2, 1, 1/2, 0, 0], [1/2, 1, 1/2, 
1/2, 0, 1/2], [1/2, 1/2, 1/2, 0, 1, 1/2], [1/2, 0, 1/2, 1/2, 1/2, 1], [1, 0, 1, 0, 1/2, 1/2], [1/2, 1/2, 1/2, 0, 1/2, 1], [0, 1/2, 1/2, 1/2, 1, 1/2], [0, 

0, 1/2, 1, 1/2, 1], [1/2, 0, 1, 1/2, 1/2, 1/2], [1/2, 0, 1/2, 1/2, 1, 1/2], [0, 1/2, 1, 1/2, 1/2, 1/2] ). 

vcrt[Q 2 ] :=([2, 2, 0, 3, 4, 0], [4, 0, 2, 3, 2, 0], [2, 0, 0, 5, 2, 2], [0, 2, 2, 3, 0, 4], [0, 7, 4, 0, 3, 3], [0, 4, 2, 1, 2, 2], [3, 4, 7, 0, 0, 3], [2, 2, 4, 

1, 0, 2], [3, 0, 0, 4, 2, 2], [5, 0, 2, 2, 2, 0], [3, 2, 0, 2, 4, 0], [3, 2, 4, 0, 0, 2], [0, 7, 3, 0, 3, 4], [1, 4, 2, 0, 2, 2], [0, 4, 3, 3, 0, 7], [1, 2, 2, 2, 0, 4], 
[0, 2, 1, 0, 1, 1], [0, 1, 1, 1, 0, 2], [1, 1, 0, 1, 2, 0], [1, 1, 2, 0, 0, 1], [2, 0, 1, 1, 1, 0], [1, 0, 0, 2, 1, 1], [2, 1, 0, 4, 2, 2], [4, 1, 2, 2, 2, 0], [7, 0, 3, 
4, 3, 0], [4, 0, 0, 7, 3, 3], [0, 5, 2, 0, 2, 2], [0, 3, 2, 2, 0, 4], [2, 3, 0, 2, 4, 0], [2, 3, 4, 0, 0, 2], [2, 2, 0, 2, 4, 1], [4, 3, 0, 3, 7, 0], [4, 0, 2, 2, 2, 
1], [7, 0, 3, 3, 4, 0], [0, 4, 2, 0, 2, 3], [0, 2, 2, 2, 0, 5], [2, 0, 0, 4, 2, 3], [2, 2, 4, 0, 0, 3], [2, 2, 4, 0, 1, 2], [0, 3, 4, 3, 0, 7], [0, 2, 2, 2, 1, 4], [3, 
3, 7, 0, 0, 4], [3, 3, 0, 4, 7, 0], [3, 0, 0, 7, 4, 3], [2, 0, 1, 4, 2, 2], [2, 2, 1, 2, 4, 0], [2, 2, 0, 2, 5, 0], [4, 0, 2, 2, 3, 0], [2, 0, 0, 4, 3, 2], [0, 4, 2, 

0, 3, 2], [0, 4, 3, 0, 2, 2], [0, 2, 3, 2, 0, 4], [4, 0, 3, 2, 2, 0], [2, 2, 5, 0, 0, 2], [4/3, 2/3, 2/3, 7/3, 4/3, 2/3], [2/3, 4/3, 4/3, 5/3, 2/3, 4/3], [7/6, 
1/3, 4/3, 5/3, 2/3, 5/6], [5/6, 2/3, 5/3, 4/3, 1/3, 7/6], [1/2, 1, 2, 2, 0, 5/2], [3/2, 1, 3, 1, 0, 3/2], [5/2, 0, 2, 2, 1, 1/2], [3/2, 0, 1, 3, 1, 3/2], 
[7/3, 2/3, 2/3, 4/3, 4/3, 2/3], [5/3, 4/3, 4/3, 2/3, 2/3, 4/3], [4/3, 2/3, 7/6, 5/6, 1/3, 5/3], [5/3, 1/3, 5/6, 7/6, 2/3, 4/3], [1, 1, 3/2, 3/2, 0, 3], 
[2, 1, 5/2, 1/2, 0, 2], [3, 0, 3/2, 3/2, 1, 1], [2, 0, 1/2, 5/2, 1, 2], [1/3, 2/3, 2/3, 1/3, 1/3, 2/3], [2/3, 1/3, 1/3, 2/3, 2/3, 1/3], [5/3, 4/3, 5/6, 
2/3, 7/6, 1/3], [4/3, 5/3, 7/6, 1/3, 5/6, 2/3], [3, 1, 3/2, 1, 3/2, 0], [2, 2, 1/2, 1, 5/2, 0], [1, 3, 3/2, 0, 3/2, 1], [2, 2, 5/2, 0, 1/2, 1], [0, 3, 1, 1, 
3/2, 3/2], [0, 2, 1, 2, 1/2, 5/2], [1, 2, 0, 2, 5/2, 1/2], [1, 1, 0, 3, 3/2, 3/2], [1/3, 5/3, 2/3, 4/3, 5/6, 7/6], [2/3, 4/3, 1/3, 5/3, 7/6, 5/6], [4/3, 
5/3, 2/3, 4/3, 4/3, 2/3], [2/3, 7/3, 4/3, 2/3, 2/3, 4/3], [0, 5/2, 1, 1/2, 2, 2], [0, 3/2, 1, 3/2, 1, 3], [1, 3/2, 0, 3/2, 3, 1], [1, 1/2, 0, 5/2, 2, 2], 
[1/3, 7/6, 2/3, 5/6, 4/3, 5/3], [2/3, 5/6, 1/3, 7/6, 5/3, 4/3], [4/3, 2/3, 2/3, 4/3, 4/3, 5/3], [2/3, 4/3, 4/3, 2/3, 2/3, 7/3], [3/2, 3/2, 3, 0, 1, 1], 
[1/2, 5/2, 2, 0, 2, 1], [3/2, 3/2, 1, 1, 3, 0], [5/2, 1/2, 2, 1, 2, 0], [5/6, 7/6, 5/3, 1/3, 4/3, 2/3], [7/6, 5/6, 4/3, 2/3, 5/3, 1/3], [2/3, 4/3, 4/3, 
2/3, 5/3, 4/3], [4/3, 2/3, 5/3, 4/3, 4/3, 2/3], [4/3, 2/3, 2/3, 4/3, 7/3, 2/3], [2/3, 4/3, 7/3, 2/3, 2/3, 4/3] ). 

vcrt[Q 3 ] := ([1, 0, 0, 0, 1, 0], [1, 2, 0, 1, 4, 0], [1, 0, 0, 3, 2, 2], [3, 0, 2, 1, 2, 0], [0, 1, 0, 0, 0, 1], [0, 3, 1, 0, 2, 2], [0, 1, 1, 2, 0, 4], [2, 1, 
3, 0, 0, 2], [2, 2, 0, 1, 3, 0], [2, 0, 0, 3, 1, 2], [4, 0, 2, 1, 1, 0], [0, 0, 0, 0, 0, 0], [2, 2, 3, 0, 0, 1], [0, 2, 1, 2, 0, 3], [0, 4, 1, 0, 2, 1], [3, 0, 2, 2, 1, 

01, [1, 0, 0, 4, 1, 2], [1, 2, 0, 2, 3, 0], [1, 0, 0, 1, 0, 0], [2, 1, 4, 0, 0, 1], [0, 1, 2, 2, 0, 3], [0, 3, 2, 0, 2, 1], [0, 1, 1, 0, 0, 0], [0, 0, 1, 0, 0, 1], [0, 0, 

0, 1, 1, 0]). 

vcrt[Q 4 ] := ([0, 2, 2, 2, 0, 3], [3, 0, 1, 3, 2, 0], [2, 1, 0, 3, 3, 0], [2, 0, 0, 4, 2, 1], [0, 6, 4, 0, 2, 3], [0, 3, 2, 1, 1, 2], [2, 4, 6, 0, 0, 3], [1, 2, 
3, 1, 0, 2], [3, 0, 0, 3, 2, 1], [4, 0, 1, 2, 2, 0], [3, 1, 0, 2, 3, 0], [2, 2, 3, 0, 0, 2], [0, 4, 3, 2, 0, 6], [0, 6, 3, 0, 2, 4], [1, 3, 2, 0, 1, 2], [1, 2, 2, 1, 0, 
3], [0, 1, 1, 0, 0, 1], [1, 0, 0, 1, 1, 0], [2, 1, 0, 3, 2, 1], [3, 1, 1, 2, 2, 0], [6, 0, 2, 4, 3, 0], [4, 0, 0, 6, 3, 2], [0, 4, 2, 0, 1, 2], [0, 3, 2, 1, 0, 3], [1, 3, 
3, 0, 0, 2], [2, 2, 0, 2, 3, 0], [2, 1, 0, 2, 3, 1], [4, 2, 0, 3, 6, 0], [3, 0, 1, 2, 2, 1], [6, 0, 2, 3, 4, 0], [0, 2, 2, 1, 0, 4], [0, 3, 2, 0, 1, 3], [1, 2, 3, 0, 0, 
3], [2, 0, 0, 3, 2, 2], [1, 2, 3, 0, 1, 2], [0, 3, 4, 2, 0, 6], [0, 2, 2, 1, 1, 3], [2, 3, 6, 0, 0, 4], [3, 2, 0, 4, 6, 0], [3, 0, 0, 6, 4, 2], [2, 0, 1, 3, 2, 1], [2, 1, 

1, 2, 3, 0], [2, 1, 0, 2, 4, 0], [2, 0, 0, 3, 3, 1], [3, 0, 1, 2, 3, 0], [0, 3, 2, 0, 2, 2], [0, 2, 3, 1, 0, 3], [0, 3, 3, 0, 1, 2], [1, 2, 4, 0, 0, 2], [3, 0, 2, 2, 2, 

01, [5/3, 1/3, 1/3, 8/3, 5/3, 1/3], [1/3, 5/3, 5/3, 4/3, 1/3, 5/3], [1/2, 1, 2, 1, 0, 3/2], [3/2, 0, 1, 2, 1, 1/2], [8/3, 1/3, 1/3, 5/3, 5/3, 1/3], [4/3, 
5/3, 5/3, 1/3, 1/3, 5/3], [1, 1, 3/2, 1/2, 0, 2], [2, 0, 1/2, 3/2, 1, 1], [2, 1, 1/2, 1, 3/2, 0], [1, 2, 3/2, 0, 1/2, 1], [0, 2, 1, 1, 1/2, 3/2], [1, 1, 0, 

2, 3/2, 1/2], [5/3, 4/3, 1/3, 5/3, 5/3, 1/3], [1/3, 8/3, 5/3, 1/3, 1/3, 5/3], [0, 3/2, 1, 1/2, 1, 2], [1, 1/2, 0, 3/2, 2, 1], [5/3, 1/3, 1/3, 5/3, 5/3, 
4/3], [1/3, 5/3, 5/3, 1/3, 1/3, 8/3], [1/2, 3/2, 2, 0, 1, 1], [3/2, 1/2, 1, 1, 2, 0], [1/3, 5/3, 5/3, 1/3, 4/3, 5/3], [5/3, 1/3, 4/3, 5/3, 5/3, 1/3], 
[5/3, 1/3, 1/3, 5/3, 8/3, 1/3], [1/3, 5/3, 8/3, 1/3, 1/3, 5/3]). 

vcrt[Q 5 ] := ([1, 2, 0, 2, 3, 0], [3, 0, 2, 2, 1, 0], [1, 0, 0, 4, 1, 2], [0, 1, 1, 3, 0, 3], [0, 4, 1, 0, 3, 0], [3, 1, 4, 0, 0, 0], [0, 4, 0, 0, 3, 1], [0, 1, 

0, 3, 0, 4], [4, 0, 2, 1, 1, 0], [2, 0, 0, 3, 1, 2], [3, 1, 3, 0, 0, 1], [2, 2, 0, 1, 3, 0], [0, 1, 0, 0, 1, 0], [0, 0, 0, 1, 0, 1], [1, 0, 1, 0, 0, 0], [1, 0, 0, 4, 0, 
3], [4, 0, 3, 1, 0, 0], [0, 2, 1, 2, 0, 3], [0, 4, 1, 0, 2, 1], [1, 3, 0, 1, 3, 0], [2, 2, 3, 0, 0, 1], [1, 3, 0, 0, 4, 0], [1, 0, 0, 3, 1, 3], [0, 3, 1, 0, 2, 2], [0, 1, 

1, 2, 0, 4], [4, 0, 3, 0, 1, 0], [2, 1, 3, 0, 0, 2], [3, 0, 2, 1, 2, 0], [1, 0, 0, 3, 2, 2], [1, 2, 0, 1, 4, 0], [0, 3, 1, 0, 3, 1], [0, 0, 1, 3, 0, 4], [3, 0, 4, 0, 0, 
1], [3, 0, 3, 1, 1, 0], [0, 0, 0, 4, 1, 3], [0, 3, 0, 1, 4, 0], [2, 1, 4, 0, 0, 1], [0, 3, 2, 0, 2, 1], [0, 1, 2, 2, 0, 3], [1/2, 1/2, 1/2, 2, 1/2, 1], [3/2, 1/2, 
3/2, 1, 1/2, 0], [1/2, 3/2, 1/2, 1, 3/2, 0], [0, 1/2, 1/2, 2, 1/2, 3/2], [0, 2, 1/2, 1/2, 2, 0], [3/2, 1/2, 2, 1/2, 1/2, 0], [1, 1/2, 0, 3/2, 1/2, 3/2], 
[1, 3/2, 0, 1/2, 3/2, 1/2], [2, 1/2, 1, 1/2, 1/2, 1/2], [2, 1/2, 3/2, 0, 1/2, 1/2], [1/2, 1/2, 0, 3/2, 1/2, 2], [1/2, 2, 0, 0, 2, 1/2], [2, 1/2, 3/2, 1/2, 
0, 1/2], [1/2, 2, 0, 1/2, 3/2, 1/2], [1/2, 1/2, 0, 2, 0, 2], [1/2, 1/2, 1/2, 2, 0, 3/2], [2, 1/2, 2, 1/2, 0, 0], [1/2, 2, 1/2, 1/2, 3/2, 0], [1/2, 1, 1/2, 
3/2, 0, 3/2], [1/2, 2, 1/2, 1/2, 1, 1/2], [3/2, 1, 3/2, 1/2, 0, 1/2], [1/2, 3/2, 1/2, 0, 2, 1/2], [1/2, 0, 1/2, 3/2, 1/2, 2], [2, 0, 2, 0, 1/2, 1/2], [3/2, 
1/2, 3/2, 0, 1/2, 1], [1/2, 1/2, 1/2, 1, 1/2, 2], [1/2, 3/2, 1/2, 0, 3/2, 1], [3/2, 0, 2, 1/2, 1/2, 1/2], [0, 0, 1/2, 2, 1/2, 2], [0, 3/2, 1/2, 1/2, 2, 
1/2], [1/2, 1, 1/2, 1/2, 2, 1/2], [1/2, 0, 1/2, 3/2, 1, 3/2], [3/2, 0, 3/2, 1/2, 1, 1/2], [0, 1/2, 1, 3/2, 1/2, 3/2], [0, 3/2, 1, 1/2, 3/2, 1/2], [1, 1/2, 

2, 1/2, 1/2, 1/2]). 
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